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SUMMARY 

AN ANALYSIS OF THE USEFULNESS OF SIMULATION GAMES 
IN AFFECTING ATTITUDINAL CHANGES AND 
SKILL-TYPE LEARNING 
by 

William K. Hart 



Scope of the S tud y 

The study evaluated the effects of a simulation game 
on attitudinal changes, motivation, and cognitive learning in 
four political science sections at San Diego Mesa College 
during the Fall Semester, 1968. The study was an attempt to 
determine whether or not a simulation gams significantly 
affected attitudes and increased motivation and cognitive 
learning. 

Procedures 



Four sections of a political science course were used. 
Random selection was used to determine two treatment and two 
control groups. Both treatment groups received the simulation 
game, and one treatment group and one control group received 
a pre- semantic differential. All four groups received a post- 
semantic differential. 

There were 150 students enrolled in the four sections. 
Attrition reduced the effective study sample to 76. Sex, 
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ethnic, and college division subgroups were formed from the 
sample , 

Tests for significant differences between groups were 
made and included adjustments for small samples. 

Conclusions 

There were statistically significant differences in 
the direction of polarization of attitudes between groups 
exposed to a simulation experience and groups which were not. 
There were also statistically significant differences between 
groups (both treatment and control) which were given the pre- 
semantic differential prior to the simulation game and those 
which were not. There were no statistically significant dif- 
ferences between groups with regard to degree of polarization 
of attitudes, implied motivation, increased cognitive material, 
sex, ethnic group, or college division. 

Discussion and Recommendations 

In this study, it was found that in the effects of simu- 
lation games only differences in the direction of polarization 
of attitudes were statistically significant; however, dif- 
ferences in degree of polarization were not. A question could 
be raised about the validity of the latter finding due to the 
high rate of attrition in the four political science sections. 

An important finding which was not expected in this 
study was that the treatment and control groups which were 




given the pre- semantic differential test consistently pro- 
duced more positive responses in polarization of attitudes# 
Therefore, it may be concluded that the semantic differential 
and simulation game complement each other in that a semantic 
differential may be used prior to a simulation experience in 
order to assist sample subjects in defining and stating their 
attitudes concerning concepts presented in the simulation. 

Future studies should Investigate more closely the 
finding that simulation games do not affect the degree of 
polarization of attitudes. 

Studies should also be conducted to investigate the 
possibility of a higher attrition rate among minority ethnic 
groups. In such a study, the semantic differential could be 
very effectively used to test for differences in attitudes 
between white Caucasian and minority ethnic groups. 

It is further recommended that more comprehensive and 
supportive means be developed to measure the possible degree 
of motivation resulting from participation in a simulation 
experience. 

The final suggestion for further study is that the 
concepts of polarization of attitudes be extended to include 
the movie and television industries, publications, and ad- 
vertising. 



CHAPTER 1 



INTRODUCTION 

One of the new teaching techniques which has developed 
during the last several years is the simulation game which is 
used in both education and industry to teach factual and con- 
ceptual knowledge , as well as skills , It is on the assump- 
tion that simulation games are now validly added to the ever- 
extending list of instructional aids and tools that this 
study was based. 



Purpose of the Study 

The primary purpose of this study was to analyze a 
plan for the evaluation of changes which may be attributed to 
participation in a simulation game- -such game or games being 
used as a teaching technique* 

More specifically, the study was designed to investi- 
gate and measure three aspects of education which cut across 
three main areas and interests of education. The first 
aspect was concerned with stated attitudes and the differences 
in understanding the meanings of various concepts which exist 
among students. When an instructor speaks of "decision- 
making" or "the democratic process," for instance, what 
meanings do students give to these terms? Since any 



experience does produce change, does simulation, in fact, 
augment, or polarize stated attitudes to a greater extent 
than, let us say, lectures, or class discussions, for 
instance? 

The second aspect of the purpose dealt with motiva- 
tion* Is it possible that simulation games will increase 
motivation in social science or a related discipline? Could 
it be that motivation remains unchanged, or is even decreas- 
ed? Will simulation engender interest in satellite areas of 
a specific discipline, such as party history, re-elections, 
etc , ? 

The third aspect of the purpose to be considered in- 
volved the learning of cognitive material. Is it possible 
to attribute to the use of simulation games any great signifi- 
cance in the improvement of learning cognitive material? 

The fourteen concepts used in the semantic differential 
and the testing for cognitive material acquired will be dis- 
cussed in more detail in Chapter III. 

Rationale of the Study 

The purpose of this study was to analyze a plan for 
the evaluation of changes which might have been contributed 
to participation in a simulation game as a teaching technique; 
specifically, the study was designed to investigate and 
measure significant changes ini 
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attitudes , 
motivation, 



3, the learning of course material in Political 
Science 10, 

4# increased participation and/or interest in govern- 
mental functions based on the recent political 
campaign and the November 5, 1968, elections 

which might have been attributed to the playing of NAPOLI. 

In the course of this study, there were four hypo- 
theses to be tested. 



Null Hypothesis la* 



Null Hypothesis lbi 



Null Hypothesis 2: 



There will be no statistically 
significant difference between 
the treatment and control groups 
in the degree of polarization of 
attitudes as indicated on the 
semantic differential question- 
naire. 

There will be no statistically 
significant difference between 
treatment and control groups in 
degree of implied motivation as 
indicated by scores on the delayed 
post-test (final examination) . 
There will be no statistically 
significant difference between 
treatment and control groups 
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scores on post-tests of cogni- 
tive skills. 



Null Hypothesis 3i 



There will be no statistically 
significant post-differences 
between treatment and control 



groups in amount of indicated 
time spent in activities covered 
in the attached questionnaire. 

Together with the above-mentioned analyses regarding 
stated attitudes and cognitive material, further analysis 
included indications in differences between groups defined 
by sex, stated college division, and race or ethnic classifi- 
cation. 
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CHAPTER II 



REVIEW OF THE LITERATURE 

I 

Current Investigation s 

According to the 1968 edition of the Subject Guide of 
Books in Print , there are only about fifty books currently 
in print in the United States concerning simulation games. 

In addition, there are comparatively few articles on the 
same subject in professional periodicals; however, indica- 
tions are that, within the next few years, the volume of 
material concerning simulation will increase considerably. 
According to the Western Behavioral Sciences Institute, La 
Jolla, California, which has become a- major clearing house 
for information on simulation, it is predicted that inter- 
est, research, and experimentation in this area will in- 
crease considerably. Information is distributed quarterly 
through their publication, "Occasional Newsletter about Uses 
of Simulations and Games for Education and Training." 

At the present time, there are three main branches of 
research in simulations teaching and training, policy guid- 
ance, and research and theory building. Currently, they 
seem to be running rather closely parallel to each other; 
however, indications point to the fact that, in the very 
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near future, these three different areas will become enti- 
ties in their own rights, since simulation is infinitely 

* 

expandable and fits together very well with systems analy- 
sis. 

Teaching and training 

Up until this point in time, at least, simulation is 
more extensively used for teaching and training, institu- 
tional structure, concepts, theory, policy guidance, re- 
search, and theory building. However, policy guidance and 
research and theory building are beginning to develop, in 
their own rights, into entities of their own. (Dill, Jack- 
son, and Sweeney, 1961? Greenlaw et al. , 1962) 

Opponents of simulation often produce arguments that 
properties of actual situations cannot be adequately repro- 
duced and that participants in a simulation never really 
escape the realization that "it does not really count." 

Before accepting these arguments at face value, it is 
worthwhile to make several points. First of all, there is 
ample evidence that participants in a simulation take the 
game very seriously indeed, whether they be junior high 
school students or mature adults. (Guetzkow, et aJL. , 1963, 
p. 13) 

Second, the form and purpose of a simulation must be 
kept in mind. For example, it is noteworthy as to the pur- 
pose and scope of a game whether a game is played by top 
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management executives on the one hand or high school seniors 
on the other. Also, there Is some evidence th&t altering the 
size of the rewards does not significantly change the be- 
havior of the participants. In addition, it is interesting 
to note that research reveals acute stress when war is immi- 
nent or actually occurs in simulation of international rela- 
tions. (Driver, 1962, p. 132) 

Third, for some time, a connection between hypnosis 
and role-playing has been noted to the extent that throwing 
one's self into a role can produce a psychic condition simi- 
lar to a trance. Therefore, it does not seem at all un- 
reasonable that participants in simulation games be tested 
for susceptibility to the role demands of the game. (Guetz- 

kow, et al. , 1963, p. 13) 

And finally, it is suggested that responsible 
decision-makers experience their own actions (either in 
anticipation or post hoc ) in the same way that participants 
in a simulation game must experience their decisions in 
order for them to be useful and legitimate. Answers are not 
self evident in the area of experiencing one's own actions, 
and judgment should be reserved until a more adequate empiri- 
cal basis has been established. 

Generally speaking, for the purposes of training and 
teaching, simulation games are used in which human decision- 
makers are used who act, interact, and react within the 
framework of a given, simulated system. (Chapmen, et al. , 
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1962, pp. 172-188? Guetzkow, 1962, pp. 82-92* and Cohen, et 
al. f 1962, pp. 104-123) "Machine-man simulation" and 
"gaming" both fall into this category of simulation games. 
Both man-machine simulations and games depend upon human 
beings (who, by the way, participate within the system as 
decision-makers, not as experimenters) and computing ma- 
\ chines (if they are called for) to simulate a social or psy- 

j; chological system or institution. This type of simulation 

may be used to train the participants in managerial posi- 
t tions, to teach the basic operations of a social or politi- 

cal institution r or (in research) to aid the behavioral 
scientist to investigate behavior by manipulating the input 
in a simulated system. The AMA Top Management Game (Ric- 
ciardi, et al. , 1958) is a prime example of a man-machine 
simulation which was developed to help train executives in 

I 

i- decision-making. The Northwestern Internation Simulation 

I (Guetzkow, 1962, pp. 82-92) and the Carnegie Tech Management 

I Game (Cohen, et al. , 1962 pp. 102-123) are designed to 

teach students about inter-nation and business relations and 
I to investigate various hypotheses concerning these systems. 

Policy Guidance 

A common regret of many people in responsible posi- 
tions is that action appears to be the enemy of thought. 
Closely coupled with this notion is the false polarity con- 
cerning theory on one hand and policy on the other. It 
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comes as no surprise, therefore* that this distinction is 
manifested within the area of simulation games. Games which 
are concerned primarily with policy seem to fall, for the 
most part, in the category of diplomatic and international 

situations . 

Many of the theoretical challenges which face scholars 
who are concerned with the development of simulation games 
appear to have two things in common: (l) a lack of relevant 

past experience which can be codified and (2) the applica- 
tion and exploration of theories and techniques which are 
not extensively applied or explored, even though the policy 
problems are ” applied” in the usual sense. Simulation, 
therefore, appears to be useful for both pure and applied 
problems. Whether or not the same simulation can serve both 
needs must be decided on the basis of the individual case 
and need. (Snyder, 1962 b, pp. 102-171) 

Simulation may also be a useful tool for clarifying 
and stabilizing the interrelations of knowledge and action. 
Boguslaw (1961, pp. 212-219) proposes a distinction between 
’’established” and ’’emergent” situations, the former being 
amenable to the application of previous learning situations 
and the latter much less so, if at all. The theorizing of 
behavioral scientists generally dsaLs with established situ- 
ations. On the other hand, however, policy-makers often 
perceive themselves to be caught in emerging situations in 
which they are dealing with unidentified parameters, 
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unpredictable systems, and a lack of analytic solutions. 
Nevertheless, it can be tentatively stated that, in the 
future, emergent situations, through simulations, can be 
brought under intellectual control by a more sophisticated 
methodology? and an ability of handling emergent situations 
can be more effectively learned by policy makers. (Snyder, 
1962 a, pp. 94-123) 

Simulation is capable of permitting the repetition of 
parameters and systems and the calculated altering of com- 
binations of these factors. It is also capable of going 
back to prior situations and playing out alternatives which 
are available but hot often chosen by participants. Through 
simulation, it is also possible to alter conditions of pre- 
vious emergent situations in order to help discover what 
might have changed decisions. Repeated trials can reveal a 
pattern of consequences of various alternatives to facili- 
tate the construction of a more objective basis for the 
acceptance of analytic tools to replace participants* intu- 
itive judgments. (Snyder, 1963, pp.. 16-18) 

Research and Theorv-Bui ldlng 

There exists today an unfortunate gap between those 
engaged in teaching knowledge and/or skills and those con- 
cerned with research and theory-building i jL.e. , university 
and college faculties, schools of education faculties, and 
psychologists who are learning specialists. The consequences 



of this separation are becoming increasingly recognized, and 
simulation may well help toward collaboration among the three 
groups# Teaching and research simulation games ought to 
feed each other# (Snyder, 1963, p. 14) 

For research purposes, simulation is likely to be 
helpful when the system cannot be dealt with experimentally. 
NAPOLI, obviously, is of this kind. We may speak of "ex- 
perimenting” with simulation games; but, strictly speaking, 
once human beings are used, the basic requirement of what 
most people understand to be a "true experiment" is ruled 
out. (Boguslaw, 1961, p. 27) By definition, in an experi- 
ment, two situations are created which are identical in all 
respects except one. (Scott et al. , 1966, p. 171) The 
difference is then described in terms of the single element# 
Therefore, it is sometimes considered that as long as human 
beings are used, a "true experiment" is all but impossible. 
However, since a simulation with any number of uncontrolled 
elements (human beings) cannot be repeated under laboratory 
conditions, researchers should not often expect to be able 
to draw hard and fast conclusions, but rather, trends and 
directions. (Bloomfield and Padeford, 1959, p. 1197) 

Simulation games should be thought of in terms of 
theory-building in the social sciences rather than as a 
laboratory experiment. (Luce and Fiaffa, 1957, p. 108) A 
simulation is a model of a real situation and is only one of 
the agents of theory-building which a researcher may choose. 



Other agents are computer models, mathematical models, writ- 
ten descriptions, and pictorial models. Simulation differs 
from some of these other agents in that hypotheses may be 
built into working models. The value of a good working 
model should never be minimized, for it can have a revolu- 
tionary effect. For example, the study of macro-economics 
did not exist before the Keynesian model was made available. 
(Allen, 1967, p. 8-42) 

Researchers in the field of simulation have made a 
distinction between congruence on one hand and abstraction 
on the other. Both of these terms refer to a relationship 
between the model and the real system. Congruence, or 
isomorphism, expressed as a matter of degree, measures how 
closely the simulation resembles the system. A simulation 
is not totally isomorphic unless the system is reproduced 
in its entirety. 

In other words, congruence is concerned with accur- 
acy, abstraction with detail; and there is no correlation 
between the two. A simulation can have a high or low degree 
of congruence and, independently, a high or low degree of 
abstraction. The significance of a low level of congruence 
is dependent upon the purpose of the simulation. In research 
a rather high degree is required; but for teaching purposes, 
a game may be entirely playable and have a low degree of 
congruence. (Scott et al, , 1966, pp. 172-173) 

The impetus behind simulation games for research 



purposes is primarily from Harold Guetzkow and his colleagues 
and students at the Center for Advanced Study in the Behav- 
ioral Sciences and the Program of Graduate Training and Re- 
search in International Relations at Northwestern University 
in the latter part of the sixth decade of this century. 
(Guetzkow, 1962, pp. 82-92) 

Guetzkow 1 s work in the field of the social psychology 
of groups (Guetzkow and Bowes, 1957, Vol. 3, pp. 380-402) 
is a happy marriage with the intellectual simulation of war 
games and social psychology group experiments at Northwest- 
ern University to bring about the beginnings of simulation 
for research purposes. (Guetzkow, 1959, pp. 183-191) In 
addition, the work of Simon and Snyder in the development 
and study of both public and private decision-making is an- 
other source upon which to draw in using simulation games 
for research purposes. (Simon, Smithburg and Thompson, 

1950, pp. 23-89; March and Simon, with Guetzkow, 1958, pp. 
271-300; Snyder, Bruch and Sapin, 1954, pp. 8-14; Snyder, 
1958, pp. 3-38) 

In using simulation for research purposes, Scott and 
his associates at the University of North Carolina (Scott 
et al. , 1966, pp. v-vii) began their work with an inter- 
nation simulation. This game led them to decide that it is 
possible to simulate developing nations (Chile and Brazil). 
Finally, they developed a simulation of a United States 
political system- -namely , Durham, N.C. Therefore, if one 
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nation or city can be simulated, so can another. Their re- 
search does at least indicate that simulation has very broad 
applications to all social systems, institutions, and situa- 
tions. 

One of the real problems with simulation for research 
is that if a simulation of a field situation is to be real- 
istic, it must needs reproduce with a rather high degree of 
fidelity the complex nature of the situation. When the com- 
plexity is built into the game, there are so many variables 
that it is difficult to have tight control over them. This 
is a far cry from a laboratory experiment in which all but 
one or two variables are controlled. (Pool & Abelson, 1962, 
p. 87) 

Another disadvantage of simulation in research has 
to do with its affinity with role-playing. In role-playing, 
a participant is placed in a static situation and is ex- 
pected to develop within the fabric of a single response to 
a stated situation. (Biddle & Thomas, 1966, pp. 16-31) In 
field situations, the participant is placed in a situation 
which is constantly in a state of flux. Therefore, he must 
adapt himself, his thoughts, and his responses to a con- 
stantly changing stage of events and conditions. For pur- 
poses of research, the critical area lies in the calibre of 
role-playing. (Biddle & Thomas, 1966, p. 17) For example, 
participants are placed together; and, almost as soon as 
communication begins , they begin to respond as a group to 






the situation. A mood may very well sweep over the group 
which may not have been anticipated and certainly can never 
be replicated in successive runs of the simulation. 

In addition to thi>s, distortion can be introduced by 
the nature of simulation itself. Participation may be al- 
tered because the participants\know that what they are doing 
is playing a game. This attitude^ can induce them to be more 
competitive or less conservative than they might be in 
reality. (Dresher, 1961, p. 87) 

A third area of difficulty in research simulations 
has to do with the theoretical, and often implicit, assump- 
tions of necessity built into the game. I A designer makes an 
assumption when he incorporates one feature and fails to in- 
corporate another. 

One of the best ways to avoid error in the design 
of a simulate, or to discover error once it has crept 
in, is for the designers to be highly self-conscious 
about the assumptions that are made. To as great ex- 
tent as possible, assumptions should be made explicit; 
error is far harder to find when it rests on an im- 
plicit assumption. (Scott, et al., 1966, p. 166) 

The final task in research, of course, is the analy- 
sis of the results; and the capacity to analyze at the 
present time is not great. Competent people from many re- 
search disciplines should help analyze research data, and 
they should be able to employ a variety of devices: such 

as communications theory, personality development theory, 
social development theory, organizational theory, small 
group analysis, etc . 



Simulation for purposes of research is likely to be 
useful in the study and analysis of a system or situation 
in which a fairly large number of elements are present and 
interacting with each other in complex relationships. Other 
research techniques allow the handling of a large number of 
variables in simple relationship or a small number of vari- 
ables in complex relationship. Simulation, on the other 
hand, has the capacity of handling a large number of vari- 
ables in complex relationship. (Dresher, 1961, p. 32) One 
can conclude from this that analysis of systems as complex 
as whole societies can now be done. 

Another advantage of simulation as a research tool is 
that it combines the advantages of the comparative and 
holistic approaches to the study of complex social systems. 
In using the comparative approach, behavioral scientists 
bring their attention and analysis to bear on isolated vari- 
ables, often at a cost being made upon synthesis in which 
systems are observed as a whole. Through simulation, there- 
fore, it is possible to validate analysis of variables with- 
in the context in which they lie. (RAND Report P-1540-RC, 
1958, p. 8) 

Simulation also has the advantages of the case study 
approach since the design and playing of a game is, for all 
practical purposes, a case study. (Snyder, 1962, p. 100) 



Summary 



In this chapter, types, techniques, uses, and pur- 
poses of simulation games have been discussed. Simulation 
is like other tools of teaching, policy guidance, and re- 
search. It certainly is not the "alpha and the omega »“ and 
it must be evaluated against other techniques along the 
criteria of applicability, cost, and simplicity and communi- 
cability. 

Certainly one of the primary advantages of simulation 
games is that they allow the experimenter to study processes 
by making any number of runs and by modifying parameters to 
observe output changes. By studying models with a wide 
variety of components, variables, and interrelationships, one 
is placed in the position of being able to study and to evalu 
ate results from a multitude of conditions and relationships. 
Conway, Johnson, and Maxwell state this rather succinctly* 

Simulation is often described as a means of incorporat 
ing a fourth dimension- -time- -in what have previously of 
necessity been static methods of analysis. (1959, p. 95) 

Another advantage of the simulation process is that 
one may expand or contract absolute time. This. is particu- 
larly advantageous for the researcher. For the teacher, in 
many situations, it is advantageous for the simulation to 
follow ordinary clock time. (Dawson, 1962, p. 11) 

Simulated systems allow the study of areas that 



ordinarily would be impractical or impossible under ordinary 
circumstances. Through simulation, one may, for example, 
study an inter-nation system with the ramifications of 
decision-makers, organizations, capacities, tensions, 
nuclear potential, etc . When various aspects of such a 
system are simulated by physical analogs, mathematical 
formulae and/or human beings, variables can be manipulated 
and characteristics of the real system inferred. The ob- 
vious feature here is that, more often than not, it is not 
possible to experiment with real people and real systems. 
Helmer and Rescher refer to experimentation of simulations 
as *' pseudo- experimentation, " and they go on to say that 

generally it may be said that in many cases judicious 
pseudo experimentation may effectively amend the oft- 
regretted infeasibility of carrying out experiments proper 
in the social sciences by providing an acceptable substi- 
tute which, moreover, has been tried and proved in the 
applied physical sciences, (1959, p. 49) 

One great joy of simulation games is that it is not 
a requirement that they be laden with complex mathematical 
formulae and processes. This fact has the two-fold advantage 
of making many games comprehensible to those who do not have 
a wide background in the particular discipline of mathematics 
and also of being able to study situations where mathematical 
methods capable of analyzing all desired variables are not 
available. 

It does seem necessary to say at this juncture that 
simulation does have the disadvantage of inadequate repro- 



duction of a real system. One must, therefore, have reliable 
mathematical, physical, or human means of reproducing the 
system; for if the replication and the operation are not 
valid, the simulation process becomes dysfunctional. 

Simulation is a useful technique provided the re- 
searcher knows enough about the real system to reproduce it 
and operate the simulation adequately. Also, one must be 
careful to select the type of simulation best suited to the 
process i machine, man-machine, physical analog, Monte 
Carlo, etc . 

Even though simulation is a recent addition to the 
tools of research and teaching, particularly in organiza- 
tional, psychological, and social processes, the increasingly 
frequent use of the term in behavorial science literature 
indicates the growing acceptance of the process as a whole 
and the increase of simulation in the future. 

As the proficiency and availability of electronic 
computers increase, as more empirical data become 
available to the social scientist, as mathematical and 
socio- psychological techniques are improved and as the 
study of human systems and processes continue, it seems 
reasonable to assume that the popularity and usefulness 
of simulation will increase. (Dawson, 1962, p. 15) 



CHAPTER III 



METHODS AND PROCEDURES 
Population Setting 

The study was conducted at San Diego Mesa College, a 
public two-year junior college, located in the City of San 
Diego, San Diego County, California. The college is one of 
three junior colleges which is a part of the San Diego Uni- 
fied School District, a K-14 district. The total active 
enrollment for the School District, as of October 11, 1968, 
was 168,421. The total active junior college enrollment, 
as of the same date, was 18,945. (Federal Survey- -State 
Report No. 4, 1968-69, p. 6) Enrollment at San Diego Mesa 
College on October 16, 1968, was 6,213. (San Diego Community 
Services, Pupil Ethnic Census Report, 1968-1969, 10/16/68, 
p. 25) 

The population from which the study sample was se- 
lected consisted of all students enrolled in San Diego Mesa , 
College during the 1968 Fall Semester. 

The 1963 Fall Semester population is described below. 
Table 1 indicates the aptitude levels of the entering stu- 
dents for the 1968 Fall Semester at San Diego Mesa College, 
as indicated by standard scores on the American College Tests. 
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TABLE 1 



MEAN SCORES AND PERCENTILES OF 1968 FALL 
SEMESTER FIRST-TIME ENTERING STUDENTS 



English Math Soc. Sci. Nat. Sci. Composite 



Mean Scores 



15.8 14.8 18.6 



18.2 



16.9 



Percentiles 



36 



33 



44 



45 



38 



(*Based on "West Coast Region, Level I;" College Student 
Profiles; p. 98) 



The ratio of males to females was approximately two 
to one. The ethnic or racial distribution of San Diego 
Mesa College students during the Fall of 1968 was (1) Span- 
ish Surname: 227 (3.7%); (2) Other Caucasian; 5,799 (93.3%); 

(3) Negro: 142 (2.3%); and (4) Other: 45 (0.7%). (San Diego 

Community Services, Pupil Ethnic Census Report, 1968-1969, 
10/16/68, p. 25) 



Mesa College were assigned by the instructor for use in the 
study. There were 150 students enrolled in these four 
classes. The effective study sample was reduced to 76 stu- 
dents through attrition. The sample was divided as follows: 



Study Sample 



Four classes of Political Scicmce 10 at San Diego 



(l) arts and science programs, 49; (2) business programs, 6; 
and (3) technical programs, 21. 
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Of the 76 students in the study sample, there were 
56 males and 21 females. In the sample, there were 44 first- 
time students, and 14 were on probation. The mean age was 
21 years of age, with a range of 18 - 49, One had not com- 
pleted high school; and the mean composite American College 
Test score, for the 52 students out of the sample of 76 who 
took the test, was 16. The ethnic or racial background of 
the sample was as follows; (1) Spanish surname, 5; (2) Other 
Caucasian, 63; (3) Negro, 7; and (4) Other, 1. 

Instrumentation 

There were five different types of instruments used 
in this study. One, used to compare the meaning of con- 
cepts, was the semantic differential. Another was a ques- 
tionnaire used to determine the amount of time in which the 
student was involved with the November 5, 1968, general 
elections. The third type of test was the qualifying exams, 
required by the State of California, on California and local 
governments and the U.S. Constitution. The fourth category 
was a test, standardized by national norms, referred to as 
"Econ A.” And finally, there were two midterm examinations 
based on the cognitive course material. 



The Semantic Differential 



The semantic differential is a generalized method of 
measuring the meaning of a concept? this method was origin- 
ated, divised, and developed by Osgood, Suci and Tannen- 
baum. (1957) The semantic differential has the advantage 
of being adaptable to the individual situation based on the 
desires of the researcher, since it is a general, rather 
than a specific, method of investigation. In the following 
sections, a description of the semantic differential will be 

i 

presented, including its validity, reliability, and limita- 
tions. The instrument, based on the semantic differential 
concept, will then be described as it was used in the study, 
along with the method of scoring. 

Rationale and General Description . In any discussion 
of the semantic differential, it is necessary to understand 
two assumptions concerning this instrument, the rationale 
for which is given by Osgood, Suci, and Tannenbaum. (1957) 
The first assumption is that the meaning of practically all 
concepts can be divided into at least three dimensions 
which are, for all practical purposes, mutually independent 
of each other. These are referred to by Osgood, Suci, and 
Tannenbaum as evaluation, potency, and activity. In addi- 
tion, each one of these dimensions can be further defined 
by a series of bi- polar scales which are represented by a 
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pair of opposite adjectives. 

' In other words, evaluation can be defined by such 
scales as important- -unimportant , beautiful -'-ugly , or other 
pairs of adjectives which represent the value or an apprai- 
sal of the concept under consideration. Potency employs 
such adjectives as positive- -negative, hard- -soft or other 
pairs which refer to the strength of a given concept. Activ- 
ity may use such pairs bf adjectives as active- -passive, 
dead- -alive, or others which describe the operation or func- 
tion of a specific concept. Obviously, these examples are 
very limited due to the fact that each dimension has an 
'infinite number of scales depending, of course, on what the 
researcher wishes to study. The adaptability and elasticity 
of this instrument is the primary reason that the semantic 
differential is considered to be a general rather than a 
specific instrument. 

When one studies these three dimensions, it becomes 
apparent that they are mutually independent. For example, 
a kitten could be described as beautiful, soft, and active; 
whereas Michelangelo's "David" might be referred to as 
beautiful, hard, and passive. Nazi Germany could be de- 
scribed as ugly, negative, and active; whereas a penicillin 
culture might be referred to as ugly, positive, and active. 
Therefore, these three dimensions (evaluations, potency, 
and activity) are separate and independent of each other. 

f 
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The second assumption upon which this description is 

based is that these three dimensions can be plotted on 

4 * 
three mutually perpendicular axes which define " semantic 

space" --not dissimilar from three-dimensional Euclidian 
space. Simply by using Euclid's model and these three 
semantic dimensions, any concept can be plotted in semantic 
space by knowing where the concept falls along each of the 
•three perpendicular axes. In other words, the three seman- 
tic dimensions (evaluation, potency, and activity) corre- 
spond to the Euclidian dimensions of x, y, and z. In order, 
then, to locate a point in three dimensional space, it is 
necessary to travel the correct distance in the direction 
parallel to each of the three respective dimensions to 
arrive at the proper location in space. Therefore, in 
order to locate a concept in semantic space, it is neces- 
sary to know how the concept is conceived in terms of the 
three dimensions --evaluation, potency, and activity. To 
be more specific, the degree of each semantic dimension 
must be known. The purpose of this discussion is for us to 
move now to see by what method one knows how far along each 
dimension he must needs move in order to locate a particular 
concept in semantic space. 

The semantic differential is designed to measure 
quantitatively the three dimensions of a concept as per- 
ceived by an individual. As a person responds to the seman- 
tic differential, he indicates his judgments of a specific 
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concept in terms of the three dimensions. The results not 
only indicate polarity, but they also show degrees of 
polarity. * 

In order to be able to employ the Euclidian model of 
space, it is practically imperative that the degree of each 
dimension be expressed in numerical terms. The semantic 
differential is designed in order that the results are 
easily stated, read, and plotted in numerical terms. Each 
possible position on the scale is assigned a "score", usu- 
ally from one to seven, A typical scale appears on the 
instrument thus: 

Interesting : : : : : \ .. Uninteresting 

If the righthand space were assigned a score of one and the 
lefthand space a score of seven, these scores would then 
correspond to locations along the evaluative dimension of 
semantic space. A score of four would indicate that the 
concept is seen by an individual in a neutral position. 

In practicality, an individual responds to a scale 
on the basis of verbal modifiers associated with each point 
on the scale. In the above example, the respondent could 
indicate that he saw a specific concept as: (l) very inter- 

esting, (2) quite interesting, (3) slightly interesting, 

(4) neither interesting or uninteresting, (5) slightly 
uninteresting, (6) quite uninteresting, or (7) very inter- 
esting. Osgood and his associates (1957, p. 327) indicated 
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that the above terras represent more or less equal degrees of 
intensity between zero and the extreme. "We have fairly 
satisfying evidence that our: seven-step scales, defined by 
the linguistic quantifiers 'extremely,' 'quite,' and 
'slightly,' in both directions from a neutral 'meaningless' 
origin, do yield nearly equal psychological units in the 
process of judgments." (p. 327) Osgood et al. used the 
terms "extremely" and "very" interchangeably. Messick 
(1957, p. 202), using the psychometric method of successive . 
intervals, also concluded that the seven-step scaling pro- 
cess with the above terms is valid. 

When the rating of a concept along the three dimen- 
sions is known in numerical terms, the result is a point in 
semantic space which can be plotted along the axes of the 
three dimensions, which is the same process as plotting 
geometrically a point in Euclidian space, given the three 
co-ordinates of the point. The genesis of semantic space, — 
where the three axes intersect,, can be considered as the 
point of "meaninglessness." Traveling away from the origin 
along one of the axes indicates the concept has meaning 
corresponding to the direction of the motion. The distance 
traveled indicates the degree of meaning in that particular 
direction. 

It follows, then that the meaning which an individual 
gives to a specific concept may be plotted at an exact 
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point in semantic space* Therefor© » the meanings given by 
five or a dozen individuals will result in either five or a 

4 

dozen exact points in space. The meaning given by several 
hundred people, on the other hand, will result in a cloud 
of points , the center of which represents the average mean- 
ing of the group. 

If it becomes desirable to compare the meanings given 
by two. individuals to the same concept, it is necessary only 
to measure the distance between the two points in space 
which represent each individual's location* Therefore, the 

meaning given by two groups of people may be measured m | 

f; I 

the same manner- -in other words, by measuring the distance j 

between the two clouds. Therefore, meanings can be measured j 

$ 

and compared which an individual or a group gives to two or j 

f l 

! I 

more concepts. 

Not only can meanings be compared between individuals 
or between groups , but also the change in meaning that may 
take place in an individual or a group may be taken into 
consideration. That is, an individual or a group reacts to 
a specific concept by means of the semantic differential 
before and after an experimental process in pre- and post- 
treatment tests. Any change of stated attitudes which re- 
sults in a change of location in semantic space with respect 
to pre- and post-tests may, therefore, be due to the experi- 
mental process. In other words, both the direction and 
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amount of change can be noted. Fox" example, as a result of 

certain classroom experimental procedures, a student may 

0 

come to have a much better understanding and appreciation of 
the problems and difficulties of management, His reaction 
to the concept "management'’ would, therefore, indicate a 
movement along the dimension of positive evaluation. 

In this study, changes in meaning were measured be- 

* 

. tween treatment and control groups in pre- and post-tests, 
using among other instruments, the semantic differential. 

The differences between the meanings assigned by the treat- 
ment and control groups were indicated by the distances 
separating the cloud locations in semantic space of the 
various groups. 

Validity . Generally speaking, the validity of an 
instrument is established by correlating it with another 
instrument which measures the same thing. It is impossible 
to establish the validity of the semantic differential in 
the same manner due to the fact that no other instrument 
exists for measuring meaning in the same way in which the 
semantic differential does,- Osgood et al. , therefore, 
looked at the problem from the standpoint of "face" valid- 
ity. They cited examples to establish how self-evident the 
validity is in most cases: 

Throughout our work with the semantic differential, 
we. have found no reasons to question the validity of 
the instrument on the basis of its correspondence with 
results to be expected from common sense. (1957, p. 

141) 



The evaluative scale is frequently employed by itself 
to measure stated attitudes; and it can, therefore, be 
correlated with other attitudinal scales. The evaluative 
scale only was used in this study. Brinton (1961) used 
this technique in measuring validity of the semantic dif- 
ferential and reported his findings: "Validity of the 

differential attitude scales appears to be high, based on 
high correlations with scores gathered by the traditional 
Thurstone, Likert, and C-uttman types of scales." (p* 2S9) 
Reliability . The reliability of the location of a 
point in semantic space is a function of the reliability of 
each of the three coordinates which determine the point. 

The reliability of the semantic differential, therefore, is 
dependent upon the reliability of each of the dimension 
(evaluation, potency, and activity) scores. In practice, 
however, each dimension score is the average of several 
scale scores, each of which represents the same dimension. 
In other words, the evaluative dimension or factor score 
should be the means of two or more, such as hard --soft, 
good- -bad, light- -heavy. By using two or more scales, the 
reliability of the total factor greatly increases, as 
opposed to using only one scale along. There were four 
scales used for each item in the semantic differential in 
this study. 
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The reliability of the data generated by the semantic 

differential is higher when ratings from two scales are 

combined to obtain factor scores than when only single 

scales are used. (DiVesta and Dick, 1966, p. 613) 

* 

As far as the reliability of the semantic differen- 
tial, using average factor scales, is concerned, Osgood, 

Suci, and Tannenbaum (1957) stated concerning test- -re- test 
data: "We find that a change in factor score of more than 

1.00 for the evaluative factor, more than 1.50 for the po- 
tency factor, and more than 1.33 for the activity factor is 
significant at about the 5 per cent level." (p. 139) The 
numbers represent steps in the seven-point scale described 
above. For example, moving one space either right or left 
along the seven- point scale represents a change in score of 
1 . 00 ; moving two points represents a change of 2.00, 

What has been said so far pertains to individuals. 

For groups, Osgood et aJL. found that a change of 0.40 
represents a significant change in factor scores. (1957, 

n 

I, 

p„ 140) Research by the authors indicates that item relia- j 

1 

bfiity, correlated across 100 subjects and 40 items, pro- I 

• \ 

duces an N of 4,000 with a resulting coefficient of .85. ! 

It is interesting to note that there seems to be 

little difference in the test--re-test reliability between I 

I 

adults and children. DiVesta and Dick (1966) found that ( 

*** i 

the semantic differential is a proper technique when used 

with children as young as the third grade, or eight years 

old. The versatility of the semantic differential is then j 







extended, since it is an appropriate instrument in comparing 
groups of all ages. 

Limitations of the Instrument . Three" limitations 
should be taken into consideration with regard to the use 
of the semantic differential as it was employed in this 
study. The first limitation was concerned with the social 
desirability of certain responses. This limitation was 
especially true since the instrument employed in the study, 
based on the semantic differential, used only the evalua- 
tive factor in conjunction with academic and political con- 
cepts. Especially since the identity of the subjects was 
known, it was certainly possible that many of them hesitated 
to indicate their true attitudes about certain concepts, A 
student enrolled in Political Science 10 might very well 
have been reluctant; to state that the concept "Political 
Science" was uninteresting, unimportant, and unnecessary. 

By the same token, an identified registered voter might not 
wish to state that the Congress is an unnecessary and nega- 
tive body, simply because this is not a socially desirable 
response. 

The second limitation was one that Osgood calls 
"concept-scale interaction." There is some evidence that 
some scales interact with some concepts which produces 

spurious results. An example of this is the "interesting-- 

/ 

uninteresting" scale as it is applied; to the concept 
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In one sense, "Political Speeches" 



"Political Speeches, 

may be interesting from the standpoint of political plat- 

* 

form and positional statements. On the other hand, they 
may very well be considered uninteresting in view of the 
fact that, on occasions , time is spent with little actual 
information being given, especially when vitriol is em- 
ployed, Therefore, a subject responding to the concept 
"Political Speeches" may possibly have had difficulty de- 
ciding whether it was interesting or uninteresting. Con- 
sequently, if this be true, the results are difficult to 
interpret • 

In actual practice, it is all but impossible to 
eliminate each and every case of concept- scale interaction. 
One indication of this interaction is having two scales 
representing the same factor correlate highly, and a third 
appreciably different. In this case, one may very well 
suspect that the scale which does not have a high correla- 
tion has interacted with the concept to pi'oduce deceptive 
results. The omnipresent possibility of concept-scale 
interaction is an excellent reason for using three or more 
scales for one factor and averaging the results. 

The third and final limitation had to do with the 
discrimination ability of the semantic differential. As 
the distance between points in semantic space increases, 
the certainty of difference between individuals or groups 



increases. Conversely, as the distance decreases, the 
certainty of difference also decreases. Therefore, if two 
points in space are close to each other, it may be difficult 
to tell if they actually represent different meanings. 

The Semantic Differential as Used in this Study . Os- 
good, Suci, and Tannenbaum state these criteria as a basis 
for selecting concepts to be used in a semantic differential 
instrument. The first criterion is that a concept must have 
only one meaning for the person responding; and finally, 
the concept should have different meanings among the subject 
involved. (1957, p. 77) Based upon the framework of NAPOLI 
the course requirements of Political Science 10 at Mesa 
Junior College, and the above stated criteria, fourteen 
concepts and the order in which they appeared in the instru>n 
ment were as follows; Political Science, Course Unit, 
Elected Officials, Republican Party, Democratic Party, Party 
Loyalty, Decision-Making, Simulation Games, Re-Election, 
Political Speeches, Responsibility, Election, Congress, and 
Democratic System. 

Each concept was rated against four scales- -sets of 
bi- polar adjectives. An attempt was made to reduce the 
social desirability factor and the concept- scale interaction 
as much as possible by eliminating scales which seemed to be 
detrimental in these respects. Scales were chosen which 
have high "loadings" in the evaluative factor. The scales 
used for this factor were: interesting- -uninteresting, 







important- -unimportant* necessary- -unecessary, and posi- 
tive- -negative, The loadings referred to above were from 
the results indicated how heavily loaded each scale was in 
each of the factors, (1957, p, 55ff) 

Subjects were asked to respond to each scale on the 
basis of a seven- step gradation as previously explained. 

The subjects were instructed that the center space was a 
neutral position and that the terms "slight”, "quite", and 
"very" were implied as one moved out from the neutral posi- 
tion toward the extreme of the scale where the adjectives 
are written. The scales were not reversed* therefore, the 
low and high ends always appeared in the same position, A 
copy of the semantic differential svay be found in Appendix 
A, and its position in the study is plotted in the Time- 
Line, Appendix F. 

Scoring . The initial scoring of the semantic dif- 
ferential used in the study was done by hand. The goal of 
the initial scoring was to find the factor score for each 
concept for each person. The seven- step scale was scored 
on the basis of one through seven, from right to left; and 
averages were calculated to the nearest one- hundredth of one 
per cent. 

It is readily seen that a semantic differential gen- 
erates vast amounts of data. Each subject, responding to 
the fourteen concepts , obtained a factor score for each 
concept, or fourteen factor scores. Fach subject in one 
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treatment and one control group made fifty- six responses on 
both pre- and post-tests; each subject In the other two 

9 

groups made fifty-six responses on the post-test only. 

These responses were punched into cards for- processing by an 
electronic computer for analysis based on BMDt Biomedical 
Computer Programs. (Dixon , 1967) By use of a computer, 
mean factor scores and standard deviation scores were ob- 
tained for the two control and the two treatment groups 
(four groups). Analysis of covariance was used to compare 
the four groups, using as variables the fourteen concepts 
listed in the semantic differential. 



California and Local Government Tests 
s' One of the course requirements in Political Science 

; 10 was a series of tests on American Institutions; namely, 

! the United States Constitution and California and local 

, governments. The Politics and Government in California 

*N r 

by Bernard L. Hyink et al. was used during the Fall Semes- 
ter of 1968 at Mesa College as the text for the study of 
California and local governments. Each student was expected 
f to study this book and to take a series of three examinations 

based on the contents of Hyink* s work during the course of 
! the semester. The first test was given before NAPOLI, the 

S last two after. The first test was based on the contents of 

i 

i Chapters 1-4, referred to as "Hyink (1-4)" in the Time-Line, 

Appendix F; the second on Chapters 5-9, "Hyink (5-9)" ; and 

I 

the last, Chapters 10-13, "Hyink (10-13)". 
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All three of the tests on California and local gov- 
ernments were composed only of multiple choice questions 
based on cognitive material. The first two contained 125 
questionsi the third, 105, The scoring was done by the 
instructor who designed the tests ! and for the purposes of 
analysis the raw scores were punched into the IBM cards for 
each student. 



"Econ A" 



I 



t 



"Econ A" is an abbriviation for ’'Test of Economic 
Understanding, Form A,” published by Science Research Asso- 
ciates in 1963, This one-hour test 'of fifty items was 
designed for use in secondary schools and colleges to test 
economic understanding and knowledge, (Interpretive Manual, 
p, l) In developing this test, S.R.A, gave it to 1,230 
high school seniors who had completed one semester of eco- 
nomics. Based on the raw score, with 50 items, the mean is 



26,28; the standard deviation, 7,74; and reliability co- 
efficient (KR-21), .81. (interpretive Manual, p. 4) 

This test was scored by hand, and for the purposes of 
analysis, the standard scores were punched into the IBM cards 
for each student. For the place in the semester of "Econ A", 
which was used as part of the immediate pre-tests, see the 
Time-Line, Appendix F. 



Midterm I 

The first midterm examination became the cognitive 



/ 



o 
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section of the Immediate post -test. Midterm X was divided 
into three parts. All three parts were scored by the in- 
structor? and for the purposes of analysis, the raw scores 
were punched into the IBM cards for each student. To see 
the position of this examination within the framework of the 
semester, see the Time-Line, Appendix F. 

The first part of Midterm X was based upon Chapters 
9-13 of Government by the People , by J. M. Burns and J. W. 
Peltason. This unit test was prepared by the authors and 
contains 130 objective questions of various types (true- 
false, multiple-choice, and f ill-in-the-blanks) . It was 
based solely on the material found in the above-mentioned 



chapters. 

The second part of Midterm I was designed by the 
instructor and is composed of 100 questions concerning 
monetary and fiscal policies of the U.S. Government. This 
test was constructed by the instructor. 

The third and final part of Midterm I consisted of 
twenty- five multiple-choice questions covering the farm 
problems in the United States. As was the test on monetary 
and fiscal policies, this test was designed by the instructor. 
Raw scores were punched into IBM cards for analysis. 



Midterm II 

The second midterm examination was administered just 



prior to the Christmas recess in the third week of December. 
(See the Time-Line, Appendix F) 






* 
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This examination was constructed by the instructor and 
was divided into two parts. The first part of Midterm IX 
was based on Chapters 14-18 of Government by the People , 

J. M. Burns and J. W. Peltason. This section of the examina- 
tion consisted of eighty true-false questions and twenty 
multiple-choice questions on the Executive and Legislative 
Branches of the Federal Government. 

The second part of Midterm II contained fifty true- 
false questions concerning international relations and the 
current foreign policy of the United States. This part of 
the examination was based on Burns & Peltason, Government 
by the People , Chapters 21-23. The raw scores were punched 
into the IBM cards. 



I U* £. Constitution 

As was stated in the section entitled "California 
and Local Government Tests," one of the course requirements 
for Political Science 10 was a test on the contents of the 
U.S, Constitution. This particular examination was the last 
r one given during the semester and its place within the fabric 

i of the course may be seen in the Time-Line, Appendix F. The 

instructor designed and scored this test which consisted of 
seventy- one multi pie- choice, nineteen true- false, and ten 
matching- questions. For the purpose of analysis, the raw 
scores were punched into the IBM cards for each student. 
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Procedure 



During the Spring Quarter of 1968, the author and 
Dr. Otto A. Heinkel, co-ordinator of research for the San 
Diego Junior Colleges, were enrolled in Dean Rucker’s 
critique course in curriculum research at United States 
International University, San Diego, California. Dr. 
Heinkel stated that his office was interested in conducting 
a study in simulation games with close investigation into 
attitudinal changes and cognitive learning. 

These conversations eventually led to a meeting at 
San Diego City College on June 28, 1968, which was attended 
by the Dean of that College, the Dean of San Diego Mesa 
College, Dr. Heinkel, faculty from the social sciences 
departments of those schools, and the investigator. The 
result of the meeting was that Mr. Gary Monell, chairman of 
the Social Science Department at San Diego Mesa College,, 
stated that he would allow four of his Political Science 10 
classes to be used for the study. 



pp. 194-195), and randomization was used for assignment of 
class sections to treatment and control groups. The Solomon 
Four-Design Paradigm can be diagramed in the following way* 



As the discussion of the study progressed, it was 
decided to use the Solomon Four-Design Paradigm (Gage, 1963, 




Pre-test Experiment 



0 

0 



X 



X 



Post-test 

0 

0 

0 

0 



Four groups or class sections, two treatment and two 
control, are required for the Solomon design. Intact classes 
were randomly assigned to one of these four groups. The 
effect of the instructor was not considered a factor since 
NAPOLI did not require leadership or direction from an 
instructor or anyone else from outside the group. In other 
words, NAPOLI is a self-contained simulation game; and the 
direction and leadership emerge from the group itself. 

As it turned out, the classes and their uses in the 
experiment were as follows* 



TABLE 2 

CLASS ASSIGNMENTS 
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Section 


Day 


Time 


Assignment* 


Pre-Test* 


25635 


M W F 


10 - 10:50 


Treatment ^ 


Yes 


25639 


M W F 


1 - 1:20 


Control^ 


Yes 


25634 


T Th 


9 - 9:50 


Treatment2 


No 


25640 


T Th 


1 - 1:20 


Contro^ 


No 



*These colums correspond to columns two and three of the 
Solomon Four-Design Paradigm. See above. 




Cont rol Group s 

During the time in which NAPOLI was being run in the 
treatment groups, the two control groups, which were not 
exposed to NAPOLI, were discussing prior and predicted vot- 

I 

ing patterns, as well as the three /major candidates for 
President (President Nixon, Mr. Humphrey, and Mr. Wallace) 
in the General Election on November .5, 1968. These dis- 
cussions were based primarily on the October 21, 1968, 
Ne wsweek and Walter Cronlcrite's C.B.S. Report on election 
probabilities. Control^ did have the pre-tests, Contro^ 

did not. 



Treatment., 

The Treatment x Group (hereafter referred to as T^) 
ran NAPOLI for four class sessions: October 28, 30, 
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November 1, and 4 (see the Time-Line Appendix F), and did 
receive the pre-test. During the first seven minutes of the 
first session, the game was explained, the Calculator and the 
Speaker were appointed. The class then divided itself into 
two parties: American Traditionalist Party (conservative, 

and hereafter referred to as the ATP) sixteen plus the 
Speaker; American Modernist Party (liberal, and hereai ter 
referred to as the AMP) thirteen. The leader of the minority 

party, the AMP, was elected 

From 10:07 - 10:22, party caucuses were held, and 
four bills from each party were presented for passing. At 



10:22, regional caucuses were held. At 10:36, the House 
met and the precedence of bills for the agenda was estab- 
lished as follows: (For a copy of the bills, see Appendix 

E) 
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TABLE 3 

TREATMENT GROUP 1 ACTIONS, SESSION 1 



Bill 


Party 


Votes 


Precedence 


Action 


1 


ATP 


10 


4 


Passes 22 - 11 


2 


AMP 


10 






3 


Bi-Partisan 


4 




* 


4 


AMP 


17 


1 


Tabled 


5 


ATP 


9 






6 


ATP 


8 






7 


AMP 


16 


2 


Motion to table defeated; 
passed, 26-7 


8 


Bi-Partisan 


3 




' 


9 


AMP 


13 


3 


Defeated,. 26-7 


10 


Bi-Partisan 


0 






11 


ATP 


5 







During this session, Bill 4, entitled, "The Federal 
Government Should Spend $11 Billion To Eliminate Extreme 
Poverty Through Direct Subsidies To The Poor" , seemed to 
create the most tension in Treatment,* 

On October 30, the last three bills from the first 

session were acted upon (See Table l) from 10:05 - 10: 17. 

/ 

Party caucuses met until 10:27; regional, until 10:37. The 
House met from 10:36 until the class period ended at 10:50. 
During this time, the agenda was again established, 



and voting began on the bills. Since Bill 4 was tabled at 

the first session, it was placed again to be considered in 

* 

the order of precedence and again received first place. 

TABLE 4 

TREATMENT GROUP-j^ ACTIONS, SESSION 2 



Bill 


p ar ty 


Votes 


Precedence 


Action 


2 


AMP 


15 


4 


Tied, 14 - 14 j defeated 
15 - 14 


3 


Bi-Partisan 


21 


2 


Motion to table de- 
feated; defeated, 16 - 11 


, 4 


AMP 


22 


1 


Motion to table de- 
feated; passed, 17 - 14 


5 


ATP 


11 






6 


ATP 


18 


3 


Passed, 17 - 11 


8 


Bi-Partisan 


4 






10 


Bi-Partisan 


3 






11 


ATP 


2 







On November 1, the last three bills from the second 
session were acted upon (See Table 2) from 10:00 - 10:16. 
The House then broke into party caucuses until 10:26 and 
regional caucuses until 10:32. From then until 10:55, 
Bills 5, 8, 10, and 11 were accepted in that order as the 
order for the agenda by a motion from the floor, which was 



carried. 
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TABLE 5 



TREATMENT GROUP 1 ACTIONS, SESSION 3 





Bill 


Party 


Action 






5 


ATP 


Defeated, 


17 - 10 




8 


Bi-Partisan 


Motion to 


table defeatedj defeated 14 - 


• 12 


10 


Bi-Partisan 


Defeated , 


14 - 12 




11 


ATP 


Defeated, 


16 - 13 





On November 4, T^, completed the third session from 
10 i 00 until 10:15. For the next ten minutes, the Calcu- 
lator's report was presented. There were no re-elections. 
A siiii nary of the action taken on each bill follows: 



I o 
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TABLE 6 

TREATMENT GROUP^ SUMMARY OF ACTIONS ON BILLS 



Bill 






Party 


Action 




1 






ATP 


Passed, 22 - 


11 


2 






AMP ' 


Defeated, 15 


- 14 


3 






Bi-Partisan 


Defeated, 16 


- 11 


4 






AMP . 


P.assed, 17 - 


14 


5 






ATP 


Defeated, 17 


- 10 


6 






ATP 


Passed, 17 - 


11 


7 






AMP 


Passed, 26 - 


7 


8 






Bi-Partisan 


Defeated, 14 


- 12 


9 






AMP . 


Defeated, 26 


- 7 


10 






Bi-Partisan 


Passed, 14 - 


12 


11 


• 




ATP 


Defeated , 16 


- 13 


TOTAL 


PASSED 


5 


. 


* 


• 


TOTAL 


DEFEATED 


6 




- 





It is the observation of the experimenter that this 
particular class (T^) was rather slow in starting; however , 
the momentum and general interest increased as the sessions 
progressed; and the speeches, as a whole, gained calibre in 
both content and manner of presentation. 

From 10:25 until the end of the period, a general 
discussion took place. The fact that the Calculator 
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reported no re-elections (since the di cast M ono’ ) came as a 
great surprise to the class* This fact led to the criticism 
that too many people voted a,long regional, rather than 
party, lines, which pointed out rather effectively the con- 
flict between regional and party interests. Another criti- 
cism which seemed to find favor was that the game itseli 
did not seem realistic enough. 

Several other ideas presented were: 

1. All the bills were concerned with fiscal matters. 

2. The arguments, as a whole, were emotional and 
not too substantial with very little of the in- 
dividual speeches based on course material. 

3. The game itself presented very well the concept 
of cross pressures. 

4. Longer periods of time would have been better. 

5. In all probability, there was no indication from 
class discussion that any minds were changed 
with regard to voting due to the speeches made, 
even though there was an independent group 
(about 8%) which could be courted by speech 
makers and swayed by the speeches. 

6. There was no evidence of M log-rolling. " 



Treatment 2 

. Treatment 2 Group (hereafter referred to as T 2 ) t which 
not was given the pre-test, began in the same way on 



ERIC 



October 28. From 9i05 - 9 1 2 3 ® the game was explained and 
the class read through the NAPOLI Student * s Manual . The 
only question asked was whether or not one may disagree 
v;ith one's own party. From 9:23 until 9:31, the Speaker 
and Calculator were appointed. The class then divided into 
two parties: the AMP (thirteen and the Speaker) and the 

ATP (nine). The leader of the minority party (ATP) was 
elected and he was able to exert strong influence on both 
his party and his regional colleagues. At 9:50, the regional 
caucuses began; at 10:05, the House met to select the order 
of precedence of the bills for the agenda. 
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TABLE 7 

TREATMENT GROUP 2 ACTIONS, SESSION 1 



Bill 


Party Votes 


Precedence 


Action 




1 


ATP 


9 


, 






2 


AMP 


5 








3 


Bi-Partisan 


3 








4 


AMP 


10 


3 


Motion to table 
passed, 14 - 11 


defeated ; 


5 


ATP 


12 


2 


Motion to table 
passed, 14 - 12 


defeated ; 


6 


ATP 


10 


4 


Motion to table 
passed, 12 - 11 


defeated ; 


7 


AMP 


16 


1 


Motion to table 
passed, 17 - 6 


defeated ; 


8 


Bi-Partisan 


9 








9 


AMP 


9 








10 


Bi-Partisan 


3 








11 


ATP 


• 8 









The second class period began at 9:00 on November 1, 

and the first twenty- seven minutes were given to finishing 

the work begun in the first session (see Table 5), Party 

caucuses lasted from 9:27 - 9:34; and regional caucuses, 

from 9:34 - 9:45, The House began its second session at 

9:46 when the agenda was once more established, and speeches 
% 1 

and voting began. 
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TABLE 8 



TREATMENT GPX'UP, ACTIONS, SESSION 2 



Bill 


Party 


Votes 


Precedence 


Action 




1 


ATP 


22 


1 


Passed, 19 - 7 




2 


AMP 


15 


3 


Passed, 17 - 6 




3 


Bi-Partisan 


5 








8 


Bi-Partisan 


13 


4 


Defeated, 17 - 


8 


9 


AMP 


9 








10 


Bi-Partisan 


3 








11 


ATP 


16 


2 


Defeated, 15 - 


11 



At 10:10, the second House session having been com- 
pleted, party caucuses met for five minutes. The regional 
caucuses lasted until 10:20: and at 10:20, the third House 
session began and the precedence of the three remaining bills 
was established for the agenda when the class period ended 
at 10:25. 



TABLE 9 





TREAT!®'' 


rr group 2 


ACTIONS, SESSION 3 




Bill 

3 


Party 

Bi -Parti sian 


Votes 

15 


Precedence 

2 


Action 
Passed, 15 - 


12 


9 


. AMP 


17 


1 


Defeated, 17 


- 10 


10 


Bi-Partisan 


9 


3 


Defeated, 18 


- 10 



I 
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The next class period, November 5, began at 9; 00 by 

finishing the third and final session with speeches, dis- 

* 

cussion, and voting on the remaining bills (see Table 7), 
The Calculator made his report between 9:30 and 9:40, A 
roll of "one" on the di defeated everyone for re-election. 
One student expressed it rather succinctly by stating, 
"Wiped out in one campaign J " 

A review of the action of T 2 on the bills follows: 

TABLE 10 



TREATMENT GROUP o , SUMMARY OF ACTIONS ON BILLS 



Bill 




Party 


Action 




1 




ATP 


Passed, 19 - 


7 


2 




AMP 


Passed, 17 - 


6 


3 


4 

l 

.» 


Bi-Partisan 


Passed, 15 - 


12 


4 




AMP 


Passed, 14 - 


11 


5 




ATP 


Defeated , 1.4 


- 12 


6 




ATP 


Passed, 12 - 


11 


7 




AMP 


Passed, 17 - 


6 


8 




Bi-Partisan 


Defeated, 17 


- 8 


9 




AMP 


Defeated, 17 


O 

I 


10 




Bi-Partisan 


Defeated, 18 


- 10 


11 




ATP 


. Defeated, 15 


- 11 


TOTAL 


PASSED 


6 






TOTAL 


DEFEATED 


5 







o 
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In the general discussion which followed, the stu- 
dents in T 2 seemed to have a better understanding of cross- 
pressures than did T^. For instead of being able to with- 
draw from a situation, they realized rather well that they 
were being forced into making a stand in voting with the 
party and/or the region. 

These students commented on the fact that NAPOLI 
seems to be rigged toward the party and that, generally, 
one has to vote the party line if he expects to be re- 
elected. The glaring exception, of course, is the Demo- 
cratic South. 

Some of the students felt that NAPOLI contains few 
major party bills and that possibly the bills could be up- 
dated. 

There was a general feeling that at times the game 
moved too fast, due possibly to the absence of committee and 
sub-committee work within NAPOLI itself. 

As in T^, very few students argued from the position 
of monetary and fiscal policy, presented earlier in the course. 
There was considerable interaction not only during the game 
but also during the discussion. The last topic discussed, 
which generated a great deal of interest, was whether or 
not the game should be more closely tied in with the cog- 
nitive material of the course and extended over a longer 
period of time, possibly even a whole semester. There were 
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no concrete suggestions given on the mechanics of how this 
could be accomplished. 

Method of Analysis 

The primary method of analysis for the study was 
the Biomedical Computer Programs (Dixon, 1967) BMDOIV, 
Analysis of Variance for One-Way Design (Dixon, 1967, pp. 
486-494), which was designed to compute an analysis-of- 
variance table for one variable of classification, with un- 
equal group sample sizes. This program was also supple- 
mented by BMD04V, Analysis of Covariance with Multiple 
Covariates (Dixon, 1967, pp. 525-542), which was designed 
to compute analysis-of-covariance information for one 
analysis-of-variance variable with multiple covariates and 
unequal treatment group sizes. Resulting F-ratios were 
interpreted for statistical significance. 

Directional differences, indicated by the semantic 
differential, were analyzed as follows* "Interesting,” 
"Important," "Necessary," and "Positive" (from the left- 
hand pole of the semantic differential) were defined as 
desirable, or positive, attitudes. Undesirable, or nega- 
tive, attitudes were associated with "Uninteresting," 
"Unimportant," "Unnecessary," and "Negative" (from the 
right-hand pole of the semantic differential). 

Directional differences were analyzed by assigning 




numeric values to the possible response position as 
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illustrated below: 

Interestin g 7 : 6 : 5 : 4 : 3 : 2 _ : 1 Uninteresting 

Ratios were formed using positive and negative re- 
sponses compared to total responses# Chi square tests for 
significance of the difference between two independent pro- 
portions were applied to each of the fourteen categories and 
to the total instrument. This statistical method was chosen 
due to the small sample size resulting from rather high 
attrition (50 per cent). 

Polarity differences were analyzed by assigning numeric 

values to the possible response positions as illustrated be- 

\ 

low: 

Interestin g 3:2:1:0:1*2:3 J Jninteresting 
Means were computed for each individual item as well 
as for the total for all fourteen items. Statistical sig- 
nificance for the difference between means was determined 
by t- tests. Variances in the four groups were considered 
sufficiently alike to permit use of the t-test. 

Summary 

The present chapter has dealt with the general methods 
and procedures which were followed in the study. The col- 
lege in which the study was conducted and the study sample 
were described first. Next, the instrument was described 
which was used to compare the meanings of concepts and the 
three types of instruments to measure cogn tive course ma- 
terial. Finally, the procedures used with the two control 
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and the two treatment groups, as well as the general methods 
of analysis, have been delineated. 



CHAPTER IV 



ANALYSIS AND INTERPRETATION OF THE DATA 

Chapter IV includes a presentation, analysis, and 
interpretation of the data relative to each of the null 
hypotheses, as stated in Chapter I, pages three and four. 

Null Hypothesis la 

There will be no statistically significant difference 
between the treatment and control, groups in the degree of 
polarization of attitudes as indicated on the semantic 
differential questionnaire. 



Findings 

The statistical findings for this hypothesis will be 
presented in two parts. The first part will treat the di- 
rection of polarization of attitudes as indicated on the 
semantic differential; the second part will present the data 
concerned with the degree of polarization. 

Differences in direction of polarity of attitudes were 
analyzed by assigning numeric values to the possible response 
positions for each student on each item of the semantic 
differential as illustrated below: 

Interestin g 7 : 6 : 5:4: 3:2:1 U n in t er e s t in g 
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Direction . The Chi square test was chosen to be used 
in determining the direction of polarization of attitudes 
for two reasons* 1.) In experimental situations, Chi 
square serves well in comparing observed frequencies of 
responses to theoretical frequencies, generated on the 
basis of the hypothesis and independent of the data at hand. 
2.) By using a "2 x 2" table to test significance, Chi 
square values can be used to calculate exact probabilities, 
since it can be well employed when the expected cell fre- 
quencies (based on the sample size) are small. 

Chi square scores were calculated by using for each 
response the following M 2 x 2" table, 



••2x2 TABLE" 



A 


B 


A + B 


C 


D 


C + D 


A+C 


B+D 


N 



in which* A = positive or negative responses in one group 
being compared ; 

A+B = total number of responses in first group; 
therefore, B = A+B-A; 

C = positive or negative responses from the 
second group being compared; 

C+D « total number of responses in second group; 
therefore, D = C-HD-C ; 

N = either (A4C)+(B+D) or (A+B)+(C+D) 




When the cells were completed for each item on the semantic 

differential for both positive and negative responses in all 

six of the group comparisons (180, "2 x 2" tables), then Chi 

2 

square = N(AD-BC) (Ferguson, 1966, p, 204) 

(A+B) (C+D) (A+C) (b+d7 # 



Directional differences indicated by the semantic 
differential were categorized and analyzed as follows* 
interesting, important, necessary, and positive (listed on 
the left-hand pole of the semantic differential) were defined 
as positive attitudes? uninteresting, unimportant, unnecessary 
and negative (listed on the right-hand pole of the semantic 
differential) were defined as negative attitudes, (See 
Appendix C, page 132) Ratios were generated by using posi- 
tive and negative responses and comparing them to total 
responses, Chi square scores were calculated to test for 
significance of the difference between two independent pro- 
portions, Tests for significance were applied to the four- 
teen categories as well as to the total semantic differential. 
Tables 11-16 present the directional scores of posi- 
tive responses, by comparing all four groups, on the 
semantic differential. Tables 17-22 present the directional 
scores of negative responses, by comparing all four groups, 
on the semantic differential. In these tables, 

Category = the items on the semantic differential? 

T^ = treatment group with pre- semantic 
differential test? 

C| = control group with pre- semantic 
differential test? 






i 




Tn « treatment group without pre- semantic 
L differential test? 

C 2 - control group without pre- semantic 
differential test? 

Chi Square - the score upon which the probability 

(p), or the difference between groups, 
is based. 

Differences between groups were accepted as statistically 
significant if the level of significance was .05, or lower. 

Tables 23 & 24 present the directional scores of both 
positive and negative responses, by comparing all four groups 
with respect to sex, race, and college division, on the 
semantic differential. In these tables, 

Category = male, female? white Caucasion, all other 
races? arts and science, vocational? 



T, = treatment group with pre- semantic 
differential test? 

C 1 = control group with pre- semantic 
differential test? 

= treatment group without pre- semantic 
differential test? 

C 2 - control group without pre- semantic 
differential test? 

Chi Square = the score upon which the probability 

(p), or the difference between groups, 
is based. 

Differences between groups were accepted as statisti- 
cally significant if the level of significance was .05, or 
lower. 

(Text continued on page 78.) 
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TABLE U 

DIRECTIONAL SCORES, SEMANTIC DIFFERENTIAL 
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CATEGORY 


T x * 


c i* 


T i - c i 


Chi square 


P 


Political Science 


. 141 


.000 


.141 


2.730 




Course Unit 


.927 


.850 


.077 


1.151 




Elected Officials 


.792 


.650 


.142 


2.313 


• 


Republican Party 


.979 


.850 


.129 


6.335 


.02 . 


Democratic Party 


.708 


.625 


.083 


.562 




Party Loyalty 


.792 


.658 


.134. 


1.953 




Dec i s i on - Maki n g 


.813 


.949 


-.136 


3.289 




Simulation Games 


.969 


.949 


.020 


.003 




Re-Election 


.781 


.625 


.156 


.233 




Political Speeches 


.917 


.625 


.292 


15.081 


.001 


Responsibility 


.719 


.525 


.194 


3.909 


.05 


Election 


.844 


.950 


' -.106 


3.966 


.05 


Congress 


.927 


.950 


-.023 


.754 




Democratic System 


.854 


.900 


. 046 


.992 




TOTAL INSTRUMENT 


.805 


.707 


.098 20.702 


.001 


*T, = ratio of number of 
sponses for T^ 


positive 


responses 


to total re 


- 


*C 1 “ ratio of numbei 
sponses for C^ 


c of , 


positive 


responses 


to total re 


- 






i 



TABLE 12 

DIRECTIONAL SCORES, SEMANTIC DIFFERENTIAL 
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CATEGORY 


T x * 


t 2 * 


T 1 - T 2 


Chi square 


P 


Political Science 


.141 


.300 


-.159 


8 . 144 


.01 


Course Unit 


.927 


.833 


.094 


2.731 




Elected Officials 


.792 


.573 


.219 


8.902 


.01 


Republican Party 


.979 


. 771 


.208 


15.985 


.001 


Democratic Party 


.70S 


.667 


.041 


1.629 




Party Loyalty 


.792 


.805 


-.013 


.172 


* 


Decision- Mak i n g 


.813 


.625 


.188 


6,450 


.02 


Simulation Games 


.969 


.139 


.830 


invalid 




Re-Election 


.781 


.456 


.325 


17.038 


.001 


Political Speeches 


.917 


.611 


.306 


21.036 


.001 


Responsibility 


.719 


.555 


.164 


4.119 


, 05 


Election 


. 844 


.764 


.080 


1.223 




Congress 


.927 


.750 


.177 


8.835 


.01 


Democratic System 


.854 


.735 


.119 


2 . 864 




TOTAL INSTRUMENT 


.805 


• 666 


.139 


7,008 


.01 


*T, «B ratio of numbe: 
1 sponses for T^ 


r of 


positive 


responses 


to total re 




*To = ratio of number of 
sponses for To 


positive 


responses 


to total re 










DIRECTIONAL SCORES, 



SEMANTIC 



DIFFERENTIAL 



CATEGORY 


1 ** 
1 1 


° 2 * 


T 1 ' C 2 


Chi square 


P 


Political Science 


.141 


.053 


.088 


2 . 689 




Course Unit 


.927 


.805 


.122 


4.500 


.05 


Elected Officials 


.192 


.111 


.070 


. 744 




Republican Party 


.979 


.763 


.216 


16.923 


.001 


Democratic Party 


.703 


. 500 


.208 


'6.714 


.01 


Party Loyalty 


.792 


.625 


.167 


4.847 


.05 


Decision-Making 


.813 


.639 


.174 


5.548 


.02 


Simulation Games 


.969 


.861 


.108 


5.254 


.05 


Re-Election 


.781 


.611 


.170 


4.970 


.05 


Political Speeches 


.917 


.111 


.195 


9.834 


.01 


Responsibility 


.719 


. 686 


.033 


.083 




Election 


.844 


.861 


-.017 


4.865 


.05 


Congress. 


.927 


.875 


.052 


.761 




Democratic System 


.854 


.809 


.045 


.311 




TOTAL INSTRUMENT 


.805 


.678 


.127 


11.680 


.001 



*t = ratio of number of posit ive responses to total re 
1 spouses for T^ 



*C ? = ratio of number of posi tive responses to total re- 

“ sponses for C 2 



